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© The invention provides a method and apparatus 
for performing image data compression. Initially, a 
two-dimensional block of image data in a spatial 
domain is transformed by a transform coder, result- 
ing in a two-dimensional array of activity coefficients 
in a frequency domain. The array is then serialized 
and quantized, yielding a one-dimensional array of 
coefficients with a leading coefficient and an original 
trailing coefficient. Next, a portion of the array is 
selected by choosing a new trailing coefficient based 
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on a setable ratio of the energy of the new short 
array to the energy of the original array. Lastly, an 
end-of-block symbol is appended after the new trail- 
ing coefficient, and the selected portion of the array 
is encoded using an entropy coder. The invention 
allows image data to enjoy enhanced compression 
with good image fidelity, and allows image fidelity to 
degrade gracefully in trade for higher degrees of 
image compression. 
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ADAPTIVE ZONAL CODER 



FIELD OF THE INVENTION 



This invention relates to image data compres- 
sion and more particularly to adaptive techniques 
for transform coding of image data for transmission 
or storage. 



BACKGROUND OF THE INVENTION 



Many communication systems require the 
transmission and/or storage of image data. Any 
technique that minimizes the amount of information 
required to encode a given image is highly de- 
sireable. Transform coding represents a major 
class of such methods. Meaningful images usually 
contain a high degree of long-range structure, i.e., 
they have high inter-element correlations. In trans- 
form coding, an image with high inter-element cor- 
relations is converted into a collection of uncor- 
rected coefficients, thereby removing most of the 
redundant information in the original image. Early 
transform techniques employed a Fourier-type 
transform. Current approaches use a discrete co- 
sine transform (DCT) or a Hadamard transform, 
both of which provide relatively higher coding effi- 
ciency. 

Commonly, an image to be encoded is par- 
titioned into a plurality of image blocks, and each 
block is divided into an 8x8 or 16x16 square array. 
The resulting blocks are encoded one after an- 
other. A typical image compression pipeline in- 
cludes a transform coder, a quantizer, and an en- 
tropy coder. A quantizer is used to map a coeffi- 
cient, falling within a range of continuous values, 
into a member of a set of discrete quantized val- 
ues, and an entropy coder uses statistical prop- 
erties of the information to compress it, i.e., to 
express the same message using fewer binary 
digits. For example, a Huffman coder relates the 
most frequent incoming data symbols to the shor- 
test outgoing codes, and the least frequent incom- 
ing data symbols to the longest outgoing codes. 
After the transform coder transforms an image 
block into a collection of uncorrelated coefficients, 
the quantizer provides the corresponding series of 
discrete values to the entropy coder. The resulting 
stream of binary digits is then either transmitted or 
stored. 

Although it is possible to retain ail the coeffi- 
cients that result from transform coding an image, 
it is neither necessary nor desirable. Due to the 
nature of the human visual system, certain coeffi- 
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cients can be omitted without degrading perceived 
image quality. By retaining only visually important 
coefficients, an image with acceptable fidelity can 
be recovered using significantly less information 

5 than provided by the transform coding process. 

For a typical two-dimensional source image, 
the transform operation results in a redistribution of 
image energy into a set of relatively few low-order 
coefficients that can be arranged in a two-dimen- 

io sional array. Visually significant coefficients are 
usually found in the upper left-hand corner of the 
array. 

According to a known method, referred to as 
'zonal coding*, only those coefficients lying within a 

75 specified zone of the array, e.g., the upper left 
quarter of the array, are retained. Although signifi- 
cant data compression can be achieved using this 
method, it is inadequate because picture fidelity is 
reduced for scenes that contain significant high 

20 frequency components. 

In an alternative approach, referred to as 
'adaptive transform coding', a block activity mea- 
sure is used to choose an optimum quantizer. 
Although this method achieves gains in efficiency 

25 by providing a degree of quantization precision 
appropriate to the activity level of a given block, 
the additional information needed to specify the 
state of the quantizer must be transmitted along 
with the usual coefficient data. 

30 

SUMMARY OF THE INVENTION 



35 The invention provides a method for image 

data compression that includes the following steps: 
transforming a two-dimensional block of image data 
in a spatial domain to data in a frequency domain. 
The transformed image data is represented as a 

40 two-dimensional array of activity coefficients. The 
two dimensional array is then serialized, resulting 
in a one-dimensional array of coefficients with a 
leading coefficient and an original trailing coeffi- 
cient. The array is then quantized. Next, a portion 

45 of the array is selected beginning with the leading 
coefficient and ending with a new trailing coefficient 
that is closer to the leading coefficient than the 
original trailing coefficient. Lastly, *an end-of-block 
symbol is appended after said new trailing coeffi- 

so cient, and the selected portion of the array is 
encoded using an entropy coder. 

In a preferred embodiment, the portion is se- 
lected by first measuring the total activity of the 
array. A measure of activity of successive sub- 
portions of the array is determined on-the-fly, and 
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added to a running total. Each new value of the 
running total is compared to the total activity of the 
array. Based on this comparison, and in a further 
preferred embodiment, on a setable level of image 
quality, a new trailing coefficient is designated, and 
only the portion of the array bounded by the lead- 
ing coefficient and the new trailing coefficient is 
presented for encoding. 

Another general feature of the invention is ap- 
paratus for inclusion in an image data compression 
pipeline, the pipeline including a transform coder, a 
serializer, a quantizer and an entropy coder. The 
apparatus includes a memory connected to said 
quantizer and said, entropy coder. The memory has 
an input and an output adapted to store and delay 
at least a block of transformed, serialized and 
quantized image data, and is adapted to provide an 
entropy coder with successive sub-portions of said 
block of image data The apparatus also includes a 
first measurer connected to the quantizer for mea- 
suring the total activity of the block of image data, 
and a second measurer connected to the output of 
the memory for measuring the activity of succes- 
sive sub-portions of the image data and computing 
a running total of the activity. A control law unit is 
connected to the first and second measurers, and 
to an entropy coder, and is adapted to compare the 
running total provided by the second measurer to a 
level based in part on the total activity provided by 
the first measurer, and sends an end-of-block sym- 
bol to the entropy encoder. The entropy coder is 
adapted to encode only a portion of the block of 
image data based on when it receives an end-of- 
block symbol. 

Thus,, it is not necessary to transmit additional 
information along with each block for indicating, 
e.g., its activity level, or run length. The end-of- 
block symbol provides an image data receiver with 
sufficient information for parsing an incoming bit 
stream back into blocks of image data. 

BRIEF DESCRIPTION OF THE DRAWINGS 



The invention will be more fully understood by 
reading the following detailed description, in con- 
junction with the accompanying drawings, in which: 

Fig. 1 is a block diagram of a typical image 

compression pipeline; 

Fig. 2 A is a representation of a 4x4 array of 
coefficients; 

Fig. 23 is a representation of a 1x16 array of 
coefficients corresponding to the array of Fig. 
2A; 

Fig. 2C is a representation of a truncated array 
of coefficients corresponding to the array of Fig. 
2B with an appended end-of-block symbol; and 
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Fig. 3 is a block diagram of the image compres- 
sion system of the invention. 



5 DETAILED DESCRIPTION OF THE INVENTION 



With reference to Fig. 1 , a typical image com- 
pression pipeline includes a transform coder 10, 

/o such as a discrete cosine transform coder (DCT), 
as disclosed in Ahmed et al., "Discrete Cosine 
Transform", IEEE Trans on Computers, Jan 1974, 
pp 90-93; a quantizer 12, such, as a linear quan- 
tizer, as described in Wintz, "Transform Picture 

is Coding", section III, Proc. IEEE, vol. 60, pp 809- 
820; and an entropy coder 14, such as a Huffman 
coder, as discussed in Huffman, "A Method for the 
Construction of Minimum-Redundancy Codes", 
Proc. IRE 40, No. 9, 1098-1101. After the transform 

20 coder 10 transforms image data into a collection of 
uncorrected coefficients, the quantizer 12 maps 
each coefficient, selected from a range of continu- 
ous values, into a member of a set of discrete 
quantized values. These quantized values are then 

25 encoded by the entropy coder. 14. The resulting 
stream of binary digits is then either transmitted or 
stored. 

Typically, image data is two-dimensional. Ac- 
cordingly, the information provided by the trans- 

30 form coder 10 is presented in the form of a two- 
dimensional array. In a preferred embodiment, a 
serializer, such as a zigzag serializer, is used to 
covert the two-dimensional array of continuous val- 
ues into a one-dimensional array of continuous 

35 values. The one-dimensional array is then quan- 
tized to yield a one-dimensional array of discrete 
values. For example, a zigzag serializer operating 
on an 4x4 array of integers as shown in Fig. 2A 
would produce a 1x16 array of integers, as shown 

40 in Fig. 2B. 

In a preferred embodiment, a zigzag serializer 
16 is included in the image compression pipeline 
between the transform coder .10 and the quantizer 
12, as shown in Fig. 3. After serializing the two- 

45 dimensional array provided by the transform coder 
10, the quantizer maps the resulting one-dimen- 
sional array of continuous values into a one-dimen- 
sional array of quantized values. The array is then 
held for one block processing interval in a one- 

so block delay memory unit 18, while an identical 
copy of the array is measured by^ a total block 
activity, measure module 20. The module 20 com- 
putes the summation of the square (or the absolute 
value) of each element in the one-dimensional ar- 

55 ray, providing a value that represents the •activity* 
or 'energy' of the image represented by the array 
to a control law module 22. 

The zigzag serializer 16 places the low-order 
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coefficients that result from, for example, a discrete 
cosine transform, at the beginning of an array, and 
the higher-order terms at the end. If there are 
sufficient low-order terms, the higher-order terms 
are of less importance and, due to the nature of the 
human visual response, may be omitted without 
perceived image degradation- For example, Fig. 2C 
shows the one-dimensional array of Fig. 2B after 
truncation of its six highest order coefficients. Since 
it is common for the activity of a block to be found 
mostly in its lower-order coefficients, transmitting 
only these coefficients results in a substantially 
greater compression of image data. However, un- 
like the known case of non-adaptive zonal coding, a 
block with significant activity in its higher-order 
coefficients will be transmitted in a manner that 
allows most of these coefficients to be included in 
the transmitted block, resulting in a received image 
of superior fidelity. Furthermore, it is not necessary 
to transmit additional information along with each 
block for indicating, e.g., its activity level. Instead, 
the end-of-block symbol 15 allows an image data 
receiver to know how to parse an incoming bit 
stream back into blocks of image data. 

After dwelling in the memory unit 18 for one 
processing interval, the one dimensional array Is 
again measured for activity. A running block activ- 
ity measure module 24 computes a running total of 
the squares or the absolute values of the elements 
in the array as it enters the module 24. A new 
value of the running total is provided to the control 
law module 22 as each additional element of the 
array enters the module 24. Also, as each element 
of the array enters the module 24, an identical 
element enters the entropy coder 14. The newly 
arriving array elements are held in a memory regis- 
ter within the entropy coder 14 until a terminate- 
block signal, representing an end-of-block char- 
acter, is provided by the control lawi module 22. A 
terminate-block signal may be generated after an 
entire array has entered the entropy encoder 14. 
Alternatively, the control law module may generate 
a terminate-block signal after a predetermined 
amount of activity has been measured by module 
24. In this case, even if the entire array has not yet 
entered the entropy coder 14, the resulting partial 
array is transmitted, with ah end-of-block symbol 
appended at the end of the partial array. 

The control law module 22 compares the total 
block activity of the current array, provided by 
module 20, with the running block activity measure, 
such as the running sum of squares or absolute 
values that is progressively generated by the mod- 
ule 24. In a preferred embodiment, a ratio or dif- 
ference circuit is included in the control law module 
22 to generate a measure of the percentage of 
current block activity. The comparison of the total 
block activity measure with the running block activ- 



ity measure indicates how much 'activity' has en- 
tered the entropy coder 14. A desired level of 
image fidelity can be set using an additional input 
26. 

5 For a given level, the number of coefficients 

transmitted will vary, depending on the distribution 
of activity among the low, middle, and high order 
coefficients. If the activity of the block is con- 
centrated in its lower order terms, it will be neces- 

10 sary to send fewer coefficients than if a large 
fraction of the blocks activity is found in the higher 
order coefficients. If the channel used for transmis- 
sion becomes overloaded, image fidelity can be 
decreased in trade for increased data compression. 

is The image data compression method of the 

invention can be used to encode any grayscale 
image or representation of the difference between 
two images. 

Other modifications and implementations will 

20 occur to those skilled in the art without departing 
from the spirit and the scope of the invention as 
claimed. Accordingly, the above description is not 
intended to limit the invention except as indicated 
in the following claims. 

25 

Claims 

1 . A method for image data compression compris- 
30 ing the steps of: 

transforming a two-dimensional block of image data 
in a spatial domain to resulting data in a frequency 
domain represented as a two-dimensional array of 
activity coefficients; 
35 serializing said entire two-dimensional array of co- 
efficients, yielding a one-dimensional array of co- 
efficients with a leading coefficient and an original 
trailing coefficient; 

quantizing said one-dimensional array of coeffi- 

40 cients;. 

selecting a portion of said one-dimensional array of 
coefficients beginning with said leading coefficient 
and ending with a new trailing coefficient that is 
closer to the leading coefficient than said original 

45 trailing coefficient; 

appending an end-of-block symbol after said new 
trailing coefficient; and 

encoding only said portion with an entropy coder. 

2. The method for image data compression of 
so claim 1, wherein said portion is selected by a 

process comprising the steps of: . 
obtaining a measure of total activity of said one- 
dimensional array of coefficients; 
determining in real time a measure of activity of 
55 successive sub-portions of said one-dimensional 
array, and adding said measure of activity to a 
running total; 

performing a comparison in real time of said run- 
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ning total to a setable level based on said measure 
of total activity; and 

designating a new trailing coefficient according to 
said comparison. 

3. The method of claim 2, wherein said sub-por- 
tions are single coefficients. 

4. The method of claim 2, wherein said setable 
level is also based on a degree of desired image 
quality. 

5. Apparatus for use in an image data compression 
pipeline comprising: 

first means for receiving and storing a one-dimen- 
sional array of coefficients, including a leading co- 
efficient and an original trailing coefficient, that 
represents a two-dimensional block of image data 
resulting from a transformation from a spatial do- 
main to a frequency domain; 
second means connected to said first means for 
selecting a portion of said one-dimensional array of 
coefficients beginning with said leading coefficient 
and ending with a new trailing coefficient that is 
closer to the leading coefficient than said original 
trailing coefficient; 

third means connected to said second means for 
appending an end-of-block symbol after said new 
trailing coefficient; and 

entropy encoder means connected to said third 
means for encoding only said portion. 

6. The apparatus of claim 5 wherein said first 
means is also connected to said entropy encoder 
means. 

7. Apparatus for image data compression compris- 
ing: 

a transform coder for transforming a two-dimen- 
sional block of image data in a spatial domain to 
resulting data in a frequency domain represented 
as a two-dimensional array of activity coefficients; 
a serializer for serializing said entire two-dimen- 
sional array of coefficients, yielding a one-dimen- 
sional array of coefficients with a leading coefficient 
and an original trailing coefficient; 
a quantizer for quantizing said one-dimensional ar- 
ray of coefficients; 

a selector for selecting a portion of said one- 
dimensional array of coefficients beginning with 
said leading coefficient and ending with a new 
trailing coefficient that is closer to the leading co- 
efficient than said original trailing coefficient; 
an appendor for appending an end-of-block symbol 
after said new trailing coefficient; and 
an entropy encoder for encoding only said portion. 

8. The apparatus of claim 7, wherein said selector 
further comprises: 

a measurer for measuring total activity of said one- 
dimensional array of coefficients; 
a measurer for obtaining a measure of activity in 
real time of successive sub-portions of said one- 
dimensional array, and for adding said measure of 



activity to a running total; 

a comparer for performing a comparison in real 
time of said running total to a setable level based 
on said measure of total activity; and 
5 designating a new trailing coefficient according to 
said comparison. 

9. The apparatus of claim 8, wherein said sub- 
portions are single coefficients. 

10. Apparatus for inclusion in an image data com- 
io pression pipeline that includes a transform coder, a 

serializer, a quantizer and an entropy coder com- 
prising: 

a memory connected to said quantizer and. said 
entropy coder with an input and an output adapted 

75 to store and delay at least a block of transformed, 
serialized and quantized image data, and adapted 
to provide an entropy coder with successive sub- 
portions of said block of image data; 
a first measurer connected to said quantizer for 

20 measuring the activity of said block of image data; 
a second measurer connected to said output of 
said memory for measuring the activity of succes- 
sive sub-portions of said image data and comput- 
ing a running total of said activity;. 

25 a control law unit connected to the first and second 
measurers, and to an entropy coder, adapted to 
compare said running total provided by said sec- 
ond measurer to a level based in part on said total 
activity provided by said first measurer, and send- 

30 ing an end-of-block signal to said entropy encoder; 
wherein said entropy coder is adapted to encode 
only a portion of said block of image data based on 
when it receives an end-of-block signal. 

11. A method for image data compression compris- 
es ing the steps of: 

transforming a two-dimensional block of image data 
from a spatial domain to a frequency domain, 
wherein said resulting block of image data in the 
frequency domain is represented by a two-dimen- 
40 sional array of activity coefficients; 

serializing said entire two-dimensional array of co- 
efficients, yielding a one-dimensional array of co- 
efficients; 

quantizing said one-dimensional array of coeffi- 
45 cients; 

selecting a visually significant portion of said one- 
dimensional array of coefficients; 
appending a symbol at a trailing end of the se- 
lected portion for indicating the end of said portion; 
so and 

coding said portion with an entropy coder. 

12. The method for image data compression of 
claim 11, wherein said selected portion of said one- 
dimensional array is selected by the steps of: 

55 obtaining a measure of total activity of the one- 
dimensional array of coefficients; 
determining in real time a running total of the 
activity of successive portions of said one-dimen- 
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sional array as they enter the entropy coder; 
performing in real time a comparison of successive 
values of said running total to a setable level based 
on said measure of total activity of the one-dimen- 
sional array of coefficients; and s 
demarking a trailing end of said one-dimensional 
array according to said comparison. 

1 3. Apparatus for use in an image processing pipe- 
line comprising: 

first means for obtaining a measure of total activity 10 
of a block of image data- 
second means for determining in real time a run- 
ning total of the activity of successive portions of 
said block of image data as said portions enter the 
entropy coder; 15 
third means connected to said first means, said 
second means and an entropy coder for performing 
a comparison of said running total to a setable 
level based on said measure of the total activity of 
the block of image data; and 20 
means connected to said third means for demar- 
king a trailing end of said one-dimensional array 
according to said comparison. 

14. The apparatus of claim 13. further comprising 
memory means connected to said entropy coder 25 
for allowing a block of image data to dwell mo- 
mentarily while said first means measures its total 
activity. 
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© Adaptive zonal coder. 



© The invention provides a method and apparatus 
for performing image data compression. Initially, a 
two-dimensional block of image data in a spatial 
domain is transformed by a transform coder, result- 
ing in a two-dimensional array of activity coefficients 
in a frequency domain. The array is then serialized 
and quantized, yielding a one-dimensional array of 
coefficients with a leading coefficient and an original 
trailing coefficient Next, a portion of the array is 
selected by choosing a new trailing coefficient based 



on a setable ratio of the energy of the new short 
array to the energy of the original array. Lastly, an 
end-of-block symbol is appended after the new trail- 
ing coefficient, and the selected portion of the array 
is encoded using an entropy coder. The invention 
allows image data to enjoy enhanced compression 
with good image fidelity, and allows image fidelity to 
degrade gracefully in trade for higher degrees of 
image compression. 
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